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ABSTRACT 

The usefulness of item sampling with unobtrusive 
measures and observational data is demonstrated. Particular emphasis 
is given to the question: Is item sampling appropriate for estimating 
the differences between means as well as the means themselves? A 
descriptive analysis is made of one aspect of a junior high school 
curriculum. Twenty four students were administered nine items from 
the "Resourcefulness Test" on three occasions. Item samples were then 
generated a posteriori from each 24 x 9 matrix, using balanced 
incomplete block design. Difference scores were examined. A 
description of student performance on each item across occasions 
constituted the curriculum evaluation*, or monitoring part of the 
study. The results show that item sampling appears to be an effective 
technique for monitoring unobtrusive measures and observational data. 
(Author/BB) 
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INTRODUCTION 



An alternative approach to curriculum evaluation has a 
particular advantage in "open education" settings v/hero students 
are participating in many different educational experiences* 
•It has further meaning when individual differences are of less 
concern than group differences in the evaluation of curricular 
ob jecti ves • 

The purpose of this paper is both methodological and 
descriptive. An adaptation of achievement monitoring was 
.employed to determine the extent to which one of the objec- 
tives of a learner-centered program at the junior high school 
level had been satisfied. The applicability of the item 
sampling approach to this problem was explored* 

The model used for the evaluation is analogous to the 
one-sample Time-Series Design (Campbell and Stanley, 1953), 
This study was concerned with behaviorally defined cognitive 
a.nd affective measures, however, rather than . tradi ti onal 
achi e vement i tems • ' 

Particular emphasis is given to the question: 

Is item sampling appropriate for estimating the differences 
between means as well as the means themselves? 

An associated purpose of the paper is an interpretation 
of the data as a partial evaluation of the curriculum at an 
"alternative" junior high school in Rochester, New York. One 
of the school's objectives i s to de ve 1 op " res ourcef u 1 ness " i n 
its students. That objective has been operationali zod in this 
study and a "resourcefulness test" has been developed to 



measure the objective. A statement a!)out changes in "resourcn- 
fulnoss" of youngsters in this setfin';) [ias implications for 
program effectiveness. Although such differences cannot be 
attributed exclusively to the effect of the school's program 
on pupil development, the monitoring technique's sensitivity 
to changes over time is important to consider. 

Estimates of mean score and standard deviation by item 
sampling ha ve been . shown to be fruitful by Lord (1 962 ) Plumlee 
(1964), Knapp (1968), Shoemaker (1971) and others. In each 
preceeding case cognitive data was used. The usefulness of 
item sampling with attitude scales has been considered in 
several studies (Bursack and Cook, 1970; Sirotnik, 1970; Pugh, 
1971; Shoemaker, 1971; Peterson and Anderson, 1971). The 
evidence indicates that item sampling techniques can be applied 
to affective measures such as atti tude seal es as well as cog- 
nitive measures. 

Knapp (1973) points out that item sampling may be espe- 
cially appropriate when the main purpose of testing is evalua- 
tion of a program rather than measurement of each individual 
relative to one another. Achievement monitoring (Gorth, Allen, 
Evans, O'Reilly, Pinsky, Wightman, 1970, Romberg, 1970) is a 
program evaluation model using item sampling. It is concerned 
with periodic testing within a course of study to help the 
teacher manage the instruction of individual students and 
revise the overall curriculum. 

This study uses the achievement monitoring model to in- 
vestigate one behavioral ly-defi ned operational i zation of the 
construct, resourcefulness. 



Subjects 



A sub- popul ati on of 24 students was drawn randomly from a 
population of approximately 500 students at the Interim Junior 
'High School in Rochester, New York. 

Interim was not organized by grades as in a traditional 
school. There were four subject matter areas --mathemati cs , 
science, soci al studies , and language arts. Each* area had four 
or five teachers responsible for a group of about twenty stu- 
dents per period. The students spent one period in each area 
every day. There were also, at Interim, resource teachers for 
such activities as art, woodworking, communication, music, 
physical education, guidance. The students were expectod to 
develop projects on which they work i ndependen tly , or with 
selected others. The projects provided the basis . for much of 
the learning which took place in school. 

I terns 

Behavioral goals for the Interim Junior High School were 
continually being developed and revised. These goals were 
independent of specific content; they are directed to the princi 
pal focus of learning in the '*open school", i.e., the acquisi- 
tion and development of process skills. 



The goal with which this study iu concerned has been stated 
i n two ways : 

Iiisti tiitional Objecti ve - students will develop resource- 
fulness, 

I ndi vi dual O b jecti ve - the student will develop the ability 
to uti 1 ize en vi r.onmental and internal resources • 
Nine "items" were developed which related to this objective. 
These were derived from discussions with school personnel and 
from a search of the literature. An attempt was made to pre- 
cisely define each item (Kunzelman, 1970), 

Item 1, * The number of different ways that a student's project 
shows creati vi ty , 



Rationale : An important aspect of learning at Interim is 
the de vefopment of independent activities, here defined as 
projects. Students engage in activities of. interest, ex-, 
ploring new areas and reinforcing weak skills. Activities 
are problem oriented, involving the students with hands-on 
experiences using a wide range of materials. The activities 
may take place anywhere within the reach of the students, 
both within the schools and the local community ( Learner- 
Centered School , 1971), 

Torrance's creativity items (Torrance, 1967) are scored for 
flexibility which is defined* as the number of different 
categories for response. The scoring adaptation of this 
item evaluates projects for the different ways in which a 
response (project content) is expressed. For example, 
projects ranged from a piece of creative writing (Score of 
1 ) to an elaborate report on the "Jewish People" including 
drawi ngs , wri tten materi al and graphs (Score of 3 ) , 

Item 2, The number of different resources a student uses in 

hi s project. 

Rati onal e : There is an attempt to provide a wide range of 
materials and many areas of interest at Interim, In addi- 
tion, home and community are consi dered to be resource 
areas for students and teachers. 

Teachers not only help students utilize resources but also 
encourage documentation of this process. 
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The Score for Item 2 v/as obtained b.y counting number of 
resources a student used in the de vel opment and completion 
of a project. This v/ac obtainec by a bi b T i ography , i f or?. 
was i nc I uded in the prbj ect ; or by di rect ques ti oni n g of 
the student. Each book, document, teacher, form of media 
v/as counted as 1 point toward total score. 

Item 3. The number of ''unusual uses" produced by a student. 

"Most people throv/ their empty cardboard boxes away> but they 
have thousands of interesting and unusual uses., In the spaces 
be.low, and on the next page, list as many of these interesting 
and unusual uses as you can think of. Do not limit yourself 
to any one size of box. You may use as many boxes as you 
like. Do not limit yourself to the uses you have, seen or 
heard about; think about as many possible new uses as you 
can." (Torrance, 1966, p. 35.) 

R ationale ; The definition of resourcefulness includes ability 
to utiTTTe internal resources. Thinking of alternative re- 
sponses would be a case of utilizing one*s internal resources. 

The fluency score, for the "unusual uses of tin cans" activity, 
is the number of different unusual uses produced. "Unusual 
use" is defined rather leniently as any relevant use other 
than the "usual use" as a container preserving food and 
other products. Other container responses detailing use 
after the can has been emptied of its original contents are 
counted. Fantastic or impossible uses are not counted. 

Item 4. The number questi ons asked by a student during a ono- 

half hour time period. 

Rationale : Educators generally agree that asking questions 
in the school setting is crucial to productive learning. 
Children, in particular, seem to like to ask questions and 
to inhibit this tendency would seem to impede learning and 
constrict horizons. 

Suskind*s study (undated) of nine classrooms in a typical 
school setting showed a large number of teacher questions, 
a small number of student questions. He used observers in 
the classroom as recorders. He classified questions into 
Procedural, Reci tat i onal , Causal, Personal, Affective, 
Normative, and Other, and calculated separate and total 
scores . 

For the present study the total number of questions asked 
■were recorded. Observers were trained in a pilot study. 

A school commi tted to the de vel opment of resourceful ness in 
youngsters would be expected to encourage question-asking 
behavior. In fact, in formal discussions indicated that thi s 
is an area in which the teachers felt they have achieved some 
success. 
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Item 5." The number of extra-curricular activities. 

Ra t i ojlcij e.: In an "open school" v;iiore currlcuUini 1s not 
tradTti onal , extra-curricular needs its own definition. 
Youngsters have a pi anned program for the purposes of. 
accountability. It includes con ventional act i vi tes such 
as Math, and unconventional activities such as Yoga. 
Extra'-cur ri cu 1 ar activities v/ere defined as those not in 
planned program and included activities taking place both 
during school (running health food store, student govern- 
ment, "student teaching") and after school hours (athletic 
activities, music 1 essons , paper delivery). 

A learner-centered approach v/hich encourages youngsters 
to pursue their interests might be expected to have more 
youn gs ters participating in activities re 1 e van t to their 
needs and i nterests . 

Item 6. The number of vi.. its to the Communication Center 

during a one-v/eek ti me peri od . 

Rational e : The Communication Center at Interim consists of 
thFee areas-" a reference library, a typewriter and business 
skills area, and an audio-visual instructional media area. 

Those who staffed the area viewed it as .a place where 
youngsters could come for information-seeking and for gain- 
ing familiarity with audio and video equipment, tyoe- 
writcrs. An open school encourages exploration cf all 
sorts of educational materials. 

Item 7. The number of times the student leaves the school 

building during the day for school related activities. 

Rati on a 1 e : An open school advocates utilization of re- 
sources i'n the community. Institutions such as libraries., 
museums, social agencies, as well as i ndi vi dual s --prof es - 
si onal , serv i ce , etc . , have been con tacte d and visited by 
youngsters i n school . 

Teachers have encouraged youngsters to individually, or 
in groups, seek out i nf ormati on outs i de of school, which 
would contribute to the development of a project. 

Item 8. An unusual object was placed on the examiner's desk 

during the administration of Item 3. On each testing 

occasion a different object was. used a collage 

composed of the inner workings of a clock, a ceramic 

Mexican bell, a group of origami figures. The number 
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of seconds required for the student to respond to the 
objoct v/ero rricorded. (A niaxiniuni time of GO seconds 
was q1 1 owed . ) 

Rationale : An increased responsiveness to the environment 
would seem to be relevant to open education. More materials, 
more opportunity to interact with ma-terials, and more oppor- 
tunity to interact with other persons could be expected to 
increase a student's curiosity^. 

Curiosity, a responsiveness and openness to. the environment, 
would seem to contribute to a youngster's ability to use 
environmental resources. 

Torrancu (1967) has suggested that a non-test way of measur- 
ing creati vi ty is a person ' s response to a new situation. 
Curiosity has been studied in young ch i 1 dren as a precursor 
to creativity. It has been defined as the ability to seek 
and maintain contact with novel stimuli. Mendel (1965) 
presented chi 1 dren wi th toy arrays , qraduated with respect 
to novelty. Smock and Holt (1952) used perceptual conflict 
as a way of determining curiosity. 

In this study, an "unusual object" was defined as something 
which would not be typically found on an exami ne r ' s des k . 
The object was placed on the desk, slightly off to one side, 
and paper and pencil were placed in front of the student. 
The examiner invited the student to sit down in front of 
the desk on wiiich there was the paper and pencil and said, 
"I will be with you in a minute, I just have to find some- 
thing in this folder." An observer was in the room while 
the examiner paused and then administered Item 3. Observer 
had a stop watch and noted response of student for 60 seconds^ 
Observers wore trained in the pilot study. 

Item 9. The number of seconds the student spent on a task. 

(Lite Brite*) 

(Li te Brite consists of colored pegs which are stuck 

in a grid. Behind grid is a light. Designs can be 

made varying color and placement of pegs.) 

Rat i onal e : Perseverance, or the ability to stick with a 
task wouTd seem to be positively related to resourceful- 
ness and the stated goals of Interim. 

An attempt was made to find a task which would have a 
universal appeal, not be sex-typed, and would depepd 
minimally on intel 1 ectual capabi 1 i ty . The Lite Brite 
seemed to meet these criteria. 



*Hassenfeld Bros., Inc. Pawtucket, R.I., U.S.A. 1957^ 



The stucent was told "I am i nteros tod i n how creative 
younoGtrru arc at intcrinu 1 wov/i'^ 1 1 ko you to make a 
design, as creative or unusual as possible," A stop 
watch was used by the examiner to determine the amount 
of time spent. 

Procedure 

.» 

Administration cf test items occurred three times during 
the second semester of the 1971-72 school year, at approximately 
one and one-half month intervals. 

All items were administered to all students on each occasion 
An item sampling a posterior i design was then imposed on the data 
100 overlapping samples of item data were drawn using a balanced 
incomplete block design, (Knapp, 1973) i.e. 

From the total of nine test items, three were sampled for 
each student on each occasion. Each item appeared eight times in 
each design; each pair of items occurred two times in each design 

Item sampling seemed appropriate, even though the number of 
items was small, because of the time and resources involved 
collecting data for each item. 

Analysis of Data 

Each 24 X 9 population matrix was sampled on each testing 
occasion, and difference matrices betv;een time 1 and time 2, 
time 2 and time 3, and time 1 and time 3 were also sampled. 

The means and the standard deviations of the 100 simples on 
each occasion were calculated. Only the item means and standard 
deviations were analyzed; not the total test score. 

These operations were performed by computer; an APL program 
was prepared for this purpose. 



Resul ts and Discussion 



Tv/onty-eight students were administered nine items on the 
first testing occasion. Due to the transfer of students to 
other schools and lack of student cooperation, only twenty-five 
students were tested on the second occasion. There were twenty- 
four students still available for testing on the third occasion, 
but, some of the data were lost due to the unexpected early 
closing of the Rochester City Schools 1n June, 1972. 

A summary of the principal findings for the twenty-four 
students for whom maximum data were available will focus on 
difference scores; since this- area does not seem to have been 
previously explored. 

Estimation of Mea n Differences 

Tables 1, 2, and 3 contain the difference scores for each 
subject on each item for each pair of occasions. Tables 4, 5, 
and 6 show a comparison of the population mean differences with 
the item sampling estimate of the mean differences, along with 
the standard deviations of the mean di f f erences (standard error). 

For item 1 , the largest difference between the population 
parameter and the mean of the sample statistics if .07 (Table 6); 
it is .05 for item 2 (Table 5); .05 for item 3 (Table. 4); .02 for 
item 4 (Table 6); .11 for item 5 (Table 6); .04 for item 6 (Table 
4); .01 for item 7 (Table 4); 6 for item 8 (Table 4) and 194 for 
item 9 (Table 6). 
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Item sanioVing appnars to give QdociatG Gstirnatos for. items 
1 - 8. The samplina mean difference deviates from the popula- 
tion mean difference in a ranqe comparable to that of sample 
mean from the population mean. Item 9 had a wide spread of 
scores and the sample estimate is consequently more deviate from 
the population mean. 

This compl etes the discussion of the results from the 
methodological point of viev/. Consideration of the substantive 
resul ts nov/ fol 1 ow. 



ERIC 



Monitoring Re sourcefulness - Curriculum Evaluation 

From the preceding data, some statements can be made about 
changes in resourcefulness of youngsters at Interim, as measured 
by items 1 - 9. Such changes, however, cannot be attributed solely 
to the curriculum since the design employed was evaluative rather 
than experimental . 

Item 1. Flexibility, or number of modes of response, did not 

appear to develop noticeably during the semester. From 
Table 6 - the item mean increased across occasions by 
.00. One student showed a substantial gain as indi- 
cated in Table 3. In general, written reports were the 
most common mode of expressio.n found in projects. 

Item 2. The number of resources used in the development of 
projects increased slightly across occasions. The 
Item mean gained .20 point as indicated in Table 6. 
Two students showed a substantial gain, one a substan- 
tial loss, as seen in Table 3. Utilization of a variety 
of resources by students grew minimally. 

-10- ' 



Item 3, The nuinber of G>:tra-curri cuL-ir activities in which 
students participated increased over tne semester, 
'lable G indicated the item mean increased by .42. 
Three students showed, an i ncrease of two activities 
(Table 3). Activities in and out of school appealed 
to a greater number of youngsters as the semester 
progressed. 

Item 4. The nuniber of times students left the building during 
the school day does not appear to have increased sub- 
stantially. The item mean increased by .13. Two 
students showed growth during the semester. Although 
more students leave- the building for information seek- 
ing and other school -rel ated activities than is typical 
in a conventional school , students at the Interim appear 
to spend moot time in school. 

Item 5. Use of the communi c? ti ons center increased slightly. ^ 
The item mean increased by .71. Four students used 
the Center more frequently; one student used the Center 
much less across time. The lack of substantial gain on 
item scores may have been due to the lack of the Center*s 
specified objectives. Many books and materials could be 
found in the areas, which meant that there was less need 
for students to use the Center. 

Item 6. The number of questions asked by students has incomplete 
data for Occasion 3. Table 4 shows that the item mean 
gained .42 from Occasion 1 to Occasion 2. Two youngsters 
showed an increase in question-asking behavior by at 
least five questions, and two showed a decrease by at 
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least five questions/ as indicatcicl in Table 1. Closer 
inspection of the data shov/s a general trend in the 
direction of more question-asking behavior. This 
observation is confirmed by teachers at Interim, who 
noted in informal interviews that more questions were 
being asked about content, as well as about philosophy, 
motivation and purpose fulness. 

Some data for Occasion 3 are missing on the Unusual Uses 
Item. Table 4 indicates a gain of .5833 from Occasion 1 
to Occasion 2. Four students thought of a greater number 
of alternative uses, two students thought of fewer uses. 
The ability to use internal resources^ as defined in 
this study, appears to be developing in youngsters at 
Interim. 

Some data for Occasion 3 is missing on the Unusual 
Object Item. Table 4 indicates a seconds gain of 17.71 
from Occasion 1 to Occasion 2. Eight students took 
longer to notice the unusual object, four students 
took less time to notice the object as shown in Table 
1. An increased responsiveness to the environment is 
not indicated by the above data as students generally 
noticed the unusual object with decreasing frequency. 
However, different objects were used on each occasion 
which may have had varying degrees. of attractiveness 
for youngsters . 

The amount of time youngs ters s pen t v/orking on the 
Li te Br i te decreased over time. The item mean across 
occasions decreased by 497.80 (Table 6). Five 
youngsters spent at least 1000 seconds less with the 
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Li to Firito ar. seen in Table 3. This item appeared 
to w ^ro u copporn u I vonoss o nJ • doc 1 1 i i. / , leather than 
resourceful ness . Youncjsters ben an to question the 
necessity of and rationale for this task and v/ere 
1 e s s V/ i 1 1 i n g 1 0 spend t i me o n i t . 

Conc l usions 

1. Item sampling appears to be an effective technique for 
monitoring unobtrusive measures. 

2. 6rov/th in resourcefulness of youngsters in the population 
as measured by "test" items has implications for curriculum 
assessment at the Interim Junior High School. Items which showed 
a negligible increase over time were Item 1 (Flexibility), Item 2 
(Number of Resources) and Item 4 (Leaving School Building). Items 
which indicated growth in resourcefulness were Item 3 (Extra- 
curricular Activities), Item 5 (Use of Communications Center), 
Item 6 (Number of Questions Asked), and Item 7 (Unusual Uses). 
Items which indicated a decrease in resourcefulness, as defined 

in this study, were Item 8 (Unusual Object) and Item 9 (Time on 
Lite Brite) . 

This study shows that item sampling can be useful for a 
wider range of data than achievement test scores or attitude 
scales. Measures such as the observations made in this study 
require much time and effort. Yet they are a helpful and a 
meaningful way to measure curricular devel opmen ts i n a school 
setting. Item sampling makes administration of such items 
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much niore reasonable. Further investigations cf this problem 
could include reliability studios, comparisons of item sampl- 
ing with total population data using larger samples and 
additional demonstrations of item sampling*s usefulness in 
behavioral, as well as cognitive, aspects of curriculum 
e.v a 1 u a t i 0 n . 



b8:03:sf 
(2/13/74) 



RIBLIOGRAPHY 



Bursack, B. and D. Cook. "Utilizinq Item Sampling Teclmiqucs 
to ScalG AffGctive Reactions to [lathoniatics . " Paper pro- 
sen tod at Annual . Meet i ng of AERA, March 1970. 

Gorth, W. P.; D. W. Allen; D. R. Evans; P. P. O'Rielly;. P. D, 

P i n s k y , and L . E . W i g h tin a n . Pes igni ng Instructional Sys teins 
with Longi tudi nal lej^JLLOjl Usi nq^ I't e n i Sdimi i n g f echnTq irp . A"" 
set of papers delivered at a syinpos i^uni at AnTTual Meeting of 
AERA, March 1970, 

Knapp, T. R. "An Application of Balanced Incomplete Block 
Designs to the Estimation of Test florms." E^duca ti onal 
and Psychological Meas u remen t , 28.1 968, pp. ?76 5 - 2 7 2 . 

. I torn- E xam i nee Sampl inn . Unpublished manuscript 

"lUni'versi ty of Rochester, 1 973 ). 

Kunzelman, H. (Ed.). Pre ci s i o n Teach i no > Seattle, Washington: 
Special Child Publications', 1170, 

T f I e L e a r n e r - C e n t e r e d Schoo l . a Document Drafted in Planning 

Stages of Interim Junior High School, Rochester, New York, 
1971. 

Lord, F. M. "Estimating Norms by Item Sampling." Educational 
and Ps ychological f leas urcm en t , 22 , 1 962 , pp. 259-267. 

Mendel, Gisela. "Children's Pre ferences-f or Differinvj Degrees 
of Novelty." C hild Devel opment , 36 , 1 965 , pp. 443-k'65, 

Petersen, D. F. and D. H. Anderson. "Closing the Communications 
Gap with Item Sampling." Paper presented at Annual Meeting 
of AERA, February, 1 971 . 

Plumlee, Lynette B. "Estimating Means and Standard Deviations 
from Partial Data - An Empirical Check on. Lord's Item 
Sampling Technique." Ed ucat ional an d Psychol og i ca l 
Measur e men i: , 24 , 1 969 , pp. 623-63'0". 

Pugh, R. C- "Empirical Evidence on the Application of Lord's 
Sampling Technique to Likert Items." Journal of Ex pe r i - 
mental Educati on , 59, 1971, pp. 54-56. 

Romberg, T. A. "Achievement Monitoring via Item Sampling."- 

Paper presented at the Annual Meeting of AERA, March, 1970. 

Shoemaker, D. M. Principles and Procedures ojf Mul ti pi e_ Matri x 
Sampl i nq . (in press) I ng 1 ewood , Cal i"f brn i a : " SWKL. 

Sirotnik, K. ''An Investigation of the Context Effect in Matrix 
Samp I i ng . " Journal of Educa t i onal Measurement , 7 , 1 970 , 
pp. 1 99-208. ~ .~ 



Smock, C. and Bess floU. "Childrori's :leactions to Novelty: An 
Experiniontal Study of Curiosity Motivation." Child Devel 
oiimoiit, 33 , 1 962 , pp. 631 -642. 

Suskind, E. "The Role of Question Asking in the Elementary 

School Classroom" in The P sy c h o - E d u c at ion a 1 CJ^ijiic^: Papers 
iM Rese arch , Edited by "S a fa's o n , S ey m o'u> , B*. " N o w o r k f 
Wi 1 ey ( no date ) . 

Torrance, E. P. T orr ance T e ^ t s^ of Crea ti ve Thinking. Princeton, 
New Jersey: Personnel P'ress, Tnc, r9 6 6 . 

. "Non-Test Ways of Identifying the Creatively Gifted" in 

Creati vi ty : Its^ Educa ti onal I in p i i ca t i ons , Edited by G o w a n , 
Demos, and Torrance . New YorkT John'^'Wifey and Sons, Inc., 
1 967 . 



166:03:sf 
(2/13/74) 



TABLES 



Q 



ERIC 



POPULATION OF DIFFERENCE SCORES, O2 - Oi 



ILXAMIXEE 
! 1 


1 


9 




4 1 


5 


6 


7 


Q 
U 


,9 


-1 


-1 


0 




-1 


4 ■ 


-S 


-10 


30 


: 9 
1 " 


0 






1 i - 




-1 1 57 


63 


! 3 


0 


0 


2 


-i 1 -2 




. -1 I 0 i 77 


, 4 


1 • 0 




-1 ! 6 j -5 ;■ 1 j -36 1 550 


•• 5 




1 




0 j 0 j 0 j 3 ! 0 j -757 




0 - 


1 : 0 


4 i 0 j -1 i -2 j 14 i -4 SO 






0 1 0 


4 i 0 


-4 1 2 ! 35 ! -520 
! 1 t 


; 8 


-1 


■ 0 j 3 


0 j -2 i 0 j 1 


-19 1 -520 




0 i i 


3 j 0 j '5 I 0 ■ ! -1 j. -837 




0 1 ■> 
1 


1 ! -J. i 2 : 2 1 45 1 -43 


11 1 -1 


-1 j 0 , 


0 i -1 j 1 i 1 ! ic 




! 


1 


2 1 3 


1 1 4 i 3 1 0 


28 


-1040 


i 1^ i 


0 


0 j 0 


-1 ; 0^-31 2 


0 


-410 


) 14 


0 1 0 i 1 


2 i 0 i 3 


2 


■ 25 


800 


■ 15 j 


-1 




0 


0 


0 


1 


1 


■ 46 1 3S0 


1 16 


1 




■° 


-2 


"3 


3 


, -27 i -2695 


■ 


3 


0 


4 


■ 0 1 5 1 -6 




56 1 -170 




_2 


-4 


-2 


0. i 5 : ' 2 


4 


-5 \ -1065 


1 15 


0 




1 


3 i 7 j 2 




60 i -40 


j 20 


-1 


0 


2 


2 ; 0 j 1 


4 ; 4 j -590 ■ 


• 21 




1 -1 


0 


. -2 


1 i -1 


1 ; ■ 10 \ 614 




~1 




0 




0 i 3 


0 1 60 1 -510 


! 2:^ 


1 


i 


3 


I -1 

• 




-2 


-1 •: 60 ! 60 ■ 


} 24 


-1 


2 


1 


0 




2 


7 


, 334 



-1- 



2 









.TIQN Cl^ 








2 









■ 0 


J 1 


/ 


5 i 


5 i 7 j 


8 














i 






; 


■( 






n i 


A 


u 








— ^.^ 




— 


.. — 








— ' ^ — 


.^w- 




— 


f ^ 


^. — 




r. 


-1- f 




- — — 







™ 






w 








, " J J* 


i 


— 




— 

. — ■ — 








■ C'i 


. 




u 







^ 














. 


■vj 





— ^ 


— ■ — 

■ _ 


~: 

0 




O 






— ,. — ' — 






1 - • 




- 




} W 






.. 








- — — — 


: 10 ■ 












. 




~. — — 




J 









— , — 







— ^ J. 




' 0 










' ■ 1 j 


»-i 






u 


— — — ^. — . 


U : 




■ 'J ; 


— ' ! i 




33 


1 " 


C 


0 


0 ■; 












t ■ . 






■ 1 


■ ■■ 0 ■ ' 


■ ■ ! 






t ^ 0 J 


■ "6 

f : - ; ; 








■ ij ^ 


■ J ■ 


5 ' 1 - i 


-.-7 




i T/' 




■J. ■ ■ ■' 


.^/^ . . 








-39 




! - s 


. i '. 










; ■- 1 . 




-7G3 




i 0 


u 


0 i 






"i • ' 


0 


-530 

■ 


i 20 


■ 0 • 


0 , 




- 1 


I 


— • . ■ — 1 




■ ■ ' 


I 21 








0 -i 












■. 2 - 




0 ,| ■ 


■ i 


. 0 i 


-3 I 2 i 




.405 . 


1 23 








0 ■ 


0 |- 


-2 i i i 


-55 


-30 


\ 24. 


: 1 


1 


0 i 


i 


-3 :j 




^•5 


-74, 



ERIC 



-2- 











:r/i'":>. 












i _ 

; i 


2 


; . 3 






6 ! 


7 




i 


: i : 


: 

; -1 . 


0 


t 0 


i 




i 




1 
\ 


-119 


2 


i - 


i ^ 


! ■- 


: 0 : 






2 


-5o 


, -i/c:-: 




I I 




: 9 


■■■ ■ . . ~ 1 




0 ■ 


0 


1 2 


155 




■ 0 




! ^ 




0 ■ 


!■ 

. 




! 


-130 


1 5 


1 ^ 




1 1 


i 0 




J ; 


0 




-S7u 


• 6 


0 


i 0 


1 


1 y- 


i "-• ( 


-4 i 




i 


-490 


7 


0 


; ^ 




i ^ 




; 


3 


i 


- i. i VjI^V 


! ■ ■ w ■ 
! " 


^. . ■ 




> 


- 1 


! - i 


; 


2 -'^ 


1 -30 

; ■ • ■ 


-236 ■ 


1 c, 
1 V 


1 - 


0 


J- ■ 


1 1 


: 0 1 


2 1 


0 


! ii 


-540 


j 10 


■ \ 

\J 




V — "1 


; ■ ■ ■ 

1 




1 i -11.4 


i 




'■ ' ■ 1 ' ■ 




■ \ ■■ 




-7 


-3oJ 






i " 


■I 

1- 


' 1 




~ '"> ; 


i 


0 i 


-937 . 


i 




- 




j ■ - .1 • 




^ i 


3 ■ - 


-55 : 


-375 




0' 


G 






i 


i 


1 


35 i 


315 


i 


0 


; - 


■ 


1 ^ 


0 i 


1 
1 




- 1:0 


i 


0 


; 




-2 




2 i 


4 


2C 1 


-2395 








0 






0 i 


0 


« . . : '. 

" \ 


- 13 J 


! Ic 


- J-:;' ■■; 






I, ! 


- i 


1 


i 


. 1 


- _ "/ 7 C 






0 


1 


2 ; 


■ JL '.I 




-i ; 


iJ i 


-5 70 . 


1 ^ i 


-i: 


0 




' 1 ! 


i 


15 i 


2 1 


5 i 


-10; 3 




1 


! 




1-2 i 


0 . i 


2 1 


0 ; 


-20 ; 


35 0 ■ 


! 22 


i 


-1 i 


0 




^ i 


0 


2, i 


10 1 


-1G5 ! 


1 




0 i 


0 


. -'^ 1 


-4, i 


-4 i 


^ i 


^ i 


33 , 


24. 




' i 


i 


! 0 


-2 i 

i 


=> i 

. ■■■■ ■■ • '■ ' 


4 


^ A 


2o0 



ERIC 



■3-- 



ITEM sAMp-Li:-:3 i-ssuLT.s TO?. DiFi- :::ir£AC-:- jjcci^rs 



* 




(i-:'-'j::i-;x v?) 




iTiL-: 








1 

! 






■0. 2549 


i . 
[ - 


! ■ n n-'^"i 




i ■ . i 


3 

: ■ ■ 


= 0 .S333 


; .. - ■ .... -7 ^, 


] ■ 0 ..4i it' 1 
1- ■ 1 


■A 


' ' ■ 0;4167 




i ■ I 
i ' ' i 

■ ■ ■ ,1 


5 


i 0.7S17 

■■ j ■■■■■■ 


Iv. ■ r ■. ■■■■ 

I 0 . £337 ' 


! 




'1 0.3750 


0.4:75 


* 0,3791 


7 


0,5333 


0.5900 j 


-0.6619 j 


S 


j 17.7033' j 


ii.0313 ! 

1 


3.1139 1 

} 


9 


i -31i.6oo7 ' 

1 

I 


-li3.Si45 


20s. 4533 \ 



.ITEM SA:.1L=LIKG IcrSUlTS FOi DI^FI'IIEXCE SCCRZS 
■ BETVJKEN CCCAS:.:G':; 3 AMD GCCASIGN 2 




ITEH SAMPLING llIirJULTS .POR Bli'i'HRl'XCH SC0:;i:3 
31i-nv£-i:>< CCCASIGM 3 AVD 1 ' 

C-'A'.jll'^l Z) 




G;1487 



0.7GS3 



.0.5938 











. : : \: \ - ' ■ - • • ■ 


















--He?; 




m 



iiiiiiitiiiiri 



